Black, white, Muslim, or Christian: Players found common ground across the board. A black chess player about to win against a light-skinned cleric. Breakthroughs, discoveries, and DIY tips sent six days a week. Chess is widely seen as a great equalizer. Players from every social, racial, and economic class have squared off across the board for nearly 1,500 years, with victories determined solely by skill and strategy.

I t was March 2016, and at the Four Seasons Hotel in Seoul, the world was gathered to watch the culmination of a battle 2,500 years in the making. On one side was the South Korean Lee Se-dol, the second-highest ranking Go player in the world. On the other was AlphaGo - a computer program developed by London-based artificial intelligence research company DeepMind. "Chess is the greatest game mankind has invented," game designer Alex Randolph once said. "Go is the greatest game mankind has discovered."

Chess, one of the oldest and most universally played board games, presents an ideal testbed due to the wealth of both policy data and language data. In terms of policy data, it is reported that over ten million games are played daily on Chess.com, the most frequented online chess platform.

Therefore, when trained on data generated by humans, we may not expect the artificial model to outperform the humans on their original objectives.

Technology AI Homemade chess board moves its own pieces. Maker Joshua Stanley Robotics used magnets and an open source chess platform to build this unique board. Breakthroughs, discoveries, and DIY tips sent six days a week. It's been nearly 30 years since chess champion Garry Kasparov lost to IBM's Deep Blue, marking the first time a reigning world champion was defeated by a computer in a match. Chess engines have since improved so dramatically that even a simple smartphone app can now make top grandmasters sweat .

Aiming to address this limitation, we present Easy2Hard-Bench, a consistently formatted collection of 6 benchmark datasets spanning various domains, such as mathematics and programming problems, chess puzzles, and reasoning questions.